syllabus
The following is a learning syllabus generated by AI (and will be modified by me as I learn more).
AI Engineering & Agentic Systems Syllabus
Module 1: The Transformer Architecture & LLM Foundations
- Research Focus: Understand the "Attention" mechanism. This is the heart of every modern LLM.
- Key Readings: Attention Is All You Need (Vaswani et al.). Focus on the Encoder-Decoder structure.
- Concepts: Tokens, Embeddings, Context Windows, and Temperature.
- Learning Goal: Be able to explain how a model predicts the next token and why "context length" is a physical hardware constraint.
Module 2: Retrieval-Augmented Generation (RAG)
- Research Focus: How to solve the "hallucination" problem by giving LLMs a "library" to look at.
- Concepts:
- Vector Embeddings: Turning text into math.
- Vector Databases: (Pinecone, Weaviate, or Milvus) for semantic search.
- Chunking Strategies: How to split a 500-page book so the AI can find the right paragraph.
- Learning Goal: Understand the pipeline: User Query → Embedding → Vector Search → Augmented Prompt → LLM Response.
Module 3: Prompt Engineering & Frameworks
- Research Focus: Moving from basic chatting to programmatic control.
- Tools: LangChain or LlamaIndex.
- Techniques: Chain-of-Thought (CoT), Few-shot prompting, and ReAct (Reason + Act) patterns.
- Learning Goal: Learn how to "chain" multiple AI calls together to solve complex problems that a single prompt can’t handle.
Module 4: Agents and Tool Use (The "Cutting Edge")
- Research Focus: How to give an LLM "hands." (e.g., letting it run a Python script or search the web).
- Concepts: Function Calling, Agentic Loops, and Self-Correction.
- Learning Goal: Understand how an AI determines which tool to use and how it handles errors when a tool returns an unexpected result.
Targeted Projects
To prove you're hireable, you need to show you can handle data and state.
Project 1: The "Compendium Oracle" (RAG System)
Build a local tool that allows you to "talk" to your own tech compendium.
- Tech Stack: Python, LangChain, FAISS (for local vector storage), and OpenAI/Anthropic API.
- The Challenge: Ingest your notes (Markdown/PDFs), store them in a vector DB, and create a CLI tool that answers technical questions based only on your notes.
- Why this works: It demonstrates you understand the most common AI pattern used in corporate environments today.
Project 2: Automated Security Auditor (Agentic Workflow)
Since you have an interest in cybersecurity, build an agent that analyzes code for vulnerabilities.
- Tech Stack: Python, an LLM with Function Calling, and a static analysis tool (like Bandit or Semgrep).
- The Workflow: The agent "reads" a Python file, decides to run a security scan tool, interprets the tool's output, and then writes a "patch" to fix the security flaw.
- Why this works: It shows you can build Agents that interact with the real world (running scripts/writing files), which is the primary direction AI engineering is heading in 2026.
Recommended Learning Resources
- DeepLearning.AI: "Short Courses" on LangChain and AI Agents (very practical).
- Andrejs Karpathy's "Zero to Hero": Specifically the video on building GPT from scratch (the gold standard for theoretical understanding).
- The "Pinecone Learning Center": Excellent for understanding vector math and retrieval.
Tags: ai